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DETAILED ACTION 

In view of the Appeal Brief filed on 02/28/201 1 , PROSECUTION IS 
HEREBY REOPENED. A new ground of rejection is set forth below. New references 
are used to disclose multiple phases registration, automatic registration and 3D 
electroanatomical mapping. 

To avoid abandonment of the application, appellant must exercise one of the 
following two options: 

(1 ) file a reply under 37 CFR 1.111 (if this Office action is non-final) or a reply 
under 37 CFR 1 .1 1 3 (if this Office action is final); or, 

(2) initiate a new appeal by filing a notice of appeal under 37 CFR 41 .31 followed 
by an appeal brief under 37 CFR 41 .37. The previously paid notice of appeal fee and 
appeal brief fee can be applied to the new appeal. If, however, the appeal fees set forth 
in 37 CFR 41 .20 have been increased since they were previously paid, then appellant 
must pay the difference between the increased fees and the amount previously paid. 

A Supervisory Patent Examiner (SPE) has approved of reopening prosecution by 
signing below: 

/Tse Chen/ 

Supervisory Patent Examiner, Art Unit 3777 



Claim Rejections - 35 USC §103 
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1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1 5, 22, 1 -3, 9-1 0, 1 4 and 1 8 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Packer et al. (US 6,556,695), in view of Leiper (US 6,128,002), 
further in view of Rose (US 2002/0176608), Hemler et al. (A System for Multi modality 
Image Fusion (provided as prior art in the IDS)), Maurincomme et al. (US 
2001/0036303) and Webler (US 2007/0055142). 

3. Addressing claims 1 5 and 22 Packer discloses at least one input interface for 
electroanatomical mapping data and 3D image data, the 3D image data being high 
resolution image data (see Fig. 1, col. 2, lines 14-60, col. 3, lines 51-67, col. 5, lines 45- 
62, Packer discloses a system that perform an imaging method therefore the system 
must have at least one input interface for electroanatomical mapping data and 3D 
image data); an extraction module, designed to extract at least significant portions of an 
area to be treated by segmenting the 3D image data to obtain a 3D surface images of 
objects in the area which is to be treated to provide selected 3D image data (see Fig. 
2A, col. 6, lines 14-45 and col. 7, lines 7-23, segmentation is used to extract data); a 
registration module connected to the extraction module designed for correlation of the 
electroanatomical mapping data and the selected 3D image data in the correct position 
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and dimension by matching the 3D surface images from the 3D image data to a 3D 
surface images from the mapping data (see Fig. 1, Fig. 8, col. 2, lines 14-60 and col. 9, 
line 21 -col.1 0, line 36); a visualization module connected to the registration module to 
provide the 3D mapping data and the selected 3D image data for visualization in the 
correct position and dimension (see abstract, Fig. 1, Fig. 8, col. 2, lines 14-60 and col. 
9, line 21 -col.10, line 36, it would have been obvious to one skill in the art at the time of 
the invention that the visualization module is connected to the registration module in 
order to display the image). Packer discloses electroanatomical mapping data. 
However, he does not explicitly disclose electroanatomical mapping data is 2D or 3D. 
Further, Packer does not explicitly disclose a system that displays multiple images or 
multiple image data next to one another or side by side, surface profile, surface 
matching and automatically register images. Leiper discloses a system that displays 
multiple images side by side on one computer monitor or on multiple computer monitors 
so operator can compare the images (see Fig. 4-6 and col. 4 lines 16-27). Rose 
discloses surface profile provide images of the surface with fine detail (see claim 9 and 
[0005-0007]). Hemler discloses surface matching (see page 335, last paragraph). 
Maurincomme explicitly discloses automatic registration of 3D images (see abstract, 
claim 1 , [0009] and [0048]; registration process is performed on a computer therefore 
there is an 3D interface for registration). Webler explicitly disclose 
electroanatomical/anatomical map is 3D (see [0014] and [0147]). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify Packer to 
have a system that displays multiple images side by side on one computer monitor or 
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on multiple computer monitors, surface profile, surface matching as taught by Leiper, 
Rose, Hemler, Maurincomme and Webler because it would be easier for comparing and 
analyzing images when displaying 3D mapping data and 3D image data side by side on 
the same monitor or in multiple monitors; the surface profile provide extensive detail 
about the surface and surface matching is more efficient for matching surface images 
because this technique does not assume a correspondence between sample points. 

Further it would have been obvious to one having ordinary skill in the art at the 
time of the invention was made to automatically register, since it has been held that 
broadly providing a mechanical or automatic means to replace manual activity which 
has accomplished the same result involves only routine skill in the art. In re Venner, 120 
USPQ 192. 

Further, resolution is associated with image quality and not dimensions. 3D 
image could have low resolution and 2D image could have high resolution. 

4. Addressing claim 1 , this method is perform by a device in claim 1 5. Therefore the 
method is rejected for the same reason as in claim 15. 

5. Addressing claims 2 and 3, Packer discloses the 3D image data of the body 
region are recorded with a method of at least one of X-ray computer tomography and 
magnetic resonance tomography (see col. 1, lines 15-35 and col. 3, lines 51-67); the 3D 
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image data of the body region are recorded by using 3D ultrasound method (see col. 1 , 
lines 15-35 and col. 3, lines 51-67). 

6. Addressing claims 1 0 and 1 4, Packer discloses the 3D image data are visualized 
via a volume rendering technique (see col. 6, line 1-13); registered 3D image data, real- 
time 3D mapping data and display a catheter in the selected 3D image data in real-time 
(see col. 2, lines 15-60 and col. 10, line 14-36). 

7. Addressing claims 9 and 18, Hemler discloses correlate the correct position and 
the correct dimension using distinct anatomical points identifiable in 3D image data and 
in the 3D mapping data as an effective way to ensure the images on display are in 
correct position and dimension (see page 335, last paragraph, page 337, line 7- page 
338, line 32). 

8. Claims 17, 21 and 6 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Packer et al. (US 6,556,695), in view of Leiper (US 6,128,002), further in view of 
Rose (US 2002/0176608), Hemler etal. (A System for Multimodality Image Fusion 
(provided as prior art in the IDS)), Maurincomme et al. (US 2001/0036303), Webler (US 
2007/0055142) and Williams et al. (DE 19953308-A1). 

9. Addressing claims 1 7 and 21 , Hemler discloses register by correlate the correct 
position and the correct dimension using distinct anatomical points as an effective way 
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to ensure the images on display are in correct position and dimension (see page 337, 
line 7- page 338, line 32); two stages of registration on page 335, last paragraph and 
page 337, line 7- page 338, line 32). Maurincomme discloses multiple stages of 
registration (see [0054] and Fig. 2). However, Packer, Leiper, Rose, Hemler, 
Maurincomme and William do not disclose correlate the correct position and the correct 
dimension using artificial marker. Williams discloses correlate the correct position and 
the correct dimension using artificial marker identifiable in 3D image data and in the 3D 
mapping data as an effective way to ensure the images on display are in correct 
position and dimension (see abstract). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to modify Packer's system to correlate the 
correct position and the correct dimension using artificial marker taught by Williams 
because using artificial markers is an effective way to ensure the images display are in 
correct position and dimension. 

1 0. Addressing claim 6, the method is perform by a device in claim 21 . Therefore the 
method is rejected for the same reason as in claim 21 . 

1 1 . Claims 23 and 1 3 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Packer et al. (US 6,556,695), in view of Leiper (US 6,128,002) and further in view 
of Rose (US 2002/0176608), Hemler et al. (A System for Multimodality Image Fusion 
(provided as prior art in the IDS)), Maurincomme et al. (US 2001/0036303), Webler (US 
2007/0055142) and Hughes et al. (US 7,233,340). 
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12. Addressing claim 23, Packer, Leiper, Rose, Hemler, Maurincomme and William 
do not disclose linking two visualizations together so that when user rotates, moves or 
scales one of the visualizations the other visualization is simultaneously subjected to the 
same rotation, movement or scaling. Hughes discloses a visualization module for linking 
two visualizations together so that when user rotates, moves or scales one of the 
visualizations the other visualization is simultaneously subjected to the same rotation, 
movement or scaling therefore the two visualizations would have the same position and 
dimension (see col. 11, lines 12-59). It would have been obvious to one of ordinary skill 
in the art at the time of the invention to modify Packer's system to link the two 
visualizations together so that when user rotates, moves or scales one of the 
visualizations the other visualization is simultaneously subjected to the same rotation, 
movement or scaling taught by Hughes because by linking two visualizations together 
so that when user rotates, moves or scales one of the visualizations the other 
visualization is simultaneously subjected to the same rotation, movement or scaling 
therefore the two visualizations would have the same position and dimension. 

1 3. Addressing claim 1 3, this method is perform by a device in claim 23. Therefore 
the method is rejected for the same reason as in claim 23. 

14. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over Packer et 
al. (US 6,556,695), in view of Leiper (US 6,128,002) and further in view of Rose (US 
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2002/0176608), Hemler et al. (A System for Multimodality Image Fusion (provided as 
prior art in the IDS)), Maurincomme et al. (US 2001/0036303), Webler (US 
2007/0055142) and Schweikard et al. (US 6,144,875). 

15. Addressing claim 8, Packer, Leiper, Rose, Hemler, Maurincomme and William do 
not disclose an artificial marker attach to the patient's thorax. Schweikard discloses an 
artificial marker attaches to the patient's thorax to measure breathing and heart beat 
(see col. 7, lines 14-32). It would have been obvious to one of ordinary skill in the art at 
the time of the invention to modify Packer's method to attach a marker to the patient's 
chest taught by Schweikard because breathing and heartbeat can be measure by 
attaching a marker to the chest. 

16. Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Packer 
et al. (US 6,556,695), in view of Leiper (US 6,128,002), and further in view of Rose (US 
2002/0176608), Hemler et al. (A System for Multimodality Image Fusion (provided as 
prior art in the IDS)), Maurincomme et al. (US 2001/0036303), Webler (US 
2007/0055142) and Krishnan (US 6,771,262). 

17. Addressing claim 1 1 , Packer, Leiper, Rose, Hemler, Maurincomme and Webler 
do not disclose an adjustable volume rendering transfer function. Krishnan discloses 
using an adjustable volume rendering transfer function to specify boundary condition to 
improve image quality (see col. 7, line 64-col.8, line 5). It would have been obvious to 
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one skill in the art at the time of the invention to modify Packer's method by using an 
adjustable volume rendering transfer function because adjustable volume rendering 
transfer function would specify boundary condition and improve image quality. 

18. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Packer 
et al. (US 6,556,695), in view of Leiper (US 6,128,002) and further in view of Rose (US 
2002/0176608), Hemler et al. (A System for Multimodality Image Fusion (provided as 
prior art in the IDS)), Maurincomme et al. (US 2001/0036303), Webler (US 
2007/0055142) and Massaro et al. (US 2002/0087329). 

19. Addressing claim 12, Packer, Leiper, Rose, Hemler, Maurincomme and Webler 
do not disclose visualized image data on a polygonal grid. Massaro discloses visualize 
image on a polygonal grid for easily matching location and determine distance (see 
claim 58). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Packer's method to visualized image data on a polygonal grid taught 
by Massaro because polygonal grid allow the viewer to easily match location and 
determine distance. 

Response to Arguments 

Applicant's arguments with respect to claims 1 , 15, 6, 17 and 21 have been 
considered but are moot in view of the new ground(s) of rejection. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HIEN NGUYEN whose telephone number is (571)270- 
7031 . The examiner can normally be reached on 7:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Robert Chen can be reached on (571) 272-3672. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/H. N./ 

Examiner, Art Unit 3777 
/Tse Chen/ 

Supervisory Patent Examiner, Art Unit 3777 



